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SHARED CACHE PARSING AND 
PREFETCH 

This application is a continuation of application Scr. No. 
08/959,313 tiled Oct. 28, 1997. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to caches. 

2. Related Art 

When presenting and reviewing data using a web browser 
or web client, that is, a client program for the web (the 
"World Wide Web") such as Netscape Corporation's "Navi- 
gator" product or Microsoft Corporation's "Internet 
Explorer" product, it is desirable to present the data with as 
little delay as possible. If the user of the web client has lo 
wait too long for the data to be displayed, this can lead to 
user dissatisfaction. 

Some web clients access the web using a proxy cache, that 
is, a device for requesting web documents on behalf of the 
web client and for caching those web documents for possible 
later use. The proxy cache acts to reduce the amount of 
communication bandwidth used between the web client and 
web servers. A proxy cache can be shared by more than one 
web client, in which case it acts to reduce the total amount 
of communication bandwidth used between all of its web 
clients and web servers. One advantage of the proxy cache 
is that web documents stored in cache can be accessed more 
q uickly than re -requesting those web documents from their 

nm^inntina wpfr ftp rvpr. 

" One problem in the art is that a document requested by the 
web client (a "web document") can include, in addition to 
text and directions for display, embedded objects which arc 
to be displayed with the web document. Embedded objects 
can include pictures, such as data in GIF or JPEG format, 
other multimedia data, such as animation, audio (such as 
streaming audio), movies, video (such as streaming video), 
program fragments, such as Java, Javascript, or ActiveX, or 
other web documents, such as when using frames. The web 
client must parse the web document to determine the embed- 
ded objects, and then request the embedded objects from the 
web server. 

While using a proxy cache ameliorates this problem 
somewhat, the problem persists. If there are many embedded 
objects in the web document, it can take substantial time to 
identify, request, communicate, and display all of them. 
Parsing and requesting embedded objects by the web client 
is serial, and most web clients are set to request only a small 
number of embedded objects at a time. Web clients request- 
ing embedded objects perform this task in parallel with 
rendering those objects for display, further slowing opera- 
tion. 

Moreover, known proxy caches use a two- level memory 
having both primary memory and secondary mass storage. 
Even those embedded objects already maintained in the 
cache, and thus accessible by the web client without request- 
ing them from the web server, may have been dropped out 
of the primary memory to secondary mass storage, possibly 
delaying communication of the embedded objects from the 
proxy cache to the web client and thus delaying display of 
those embedded objects to the user. 

Accordingly, it would be advantageous to provide a 
method and system for reducing latency in reviewing and 
presenting web documents lo the user. This advantage is 
achieved in a system in which web documents are parsed by 
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a cache for references to embedded objects, and those 
embedded objects are pre -fetched from the web server or 
pre-loaded from secondary mass storage by the cache before 
they arc requested by the web client. 

- Teachings of the art include (1) the known principle of 
computer science that devices work better when they are 
indifferent to the nature of the data they process, and (2) the 
known principle of client-server systems that it is advanta- 
geous to assign processing- intensive tasks to clients, rather 

10 than to servers, whenever possible. The invention is counter 
to the (irst teaching, as the cache alters its behavior in 
response to its parsing of the web documents it receives for 
communication to the client. I*he invention is also counter lo 
the second teaching, as the cache takes on the additional 

15 processing tasks of parsing the web document for embedded 
objects and, if necessary, independently requesting those 
embedded objects from the web server. 

SUMMARY OF THE INVENTION 

20 

The invention provides a method and system for reducing 
latency in reviewing and presenting web documents to the 
user. A cache coupled lo one or more web clients request 
web documents from web serve rs on behalf of those web 

?5 clients and c ommunicates those web documents to the^ veb 
clients for display . The cache parses the web documents as 
t hey are received from the web server, identifies reference s 
to any embedded objects, and determines if those embedd ed 
objects , fl fc already macula incd i f) |hc cache I f those cmbcd- 

30 ded objec ts are not in the cache, the cache automatically 
fee-fetchj ^ th ose em bedded objects from the web server 
wit hout need tor acomfflana fr om tne web c lient 

In a preferred embodiment, the cache maintains a two- 
level memory including primary memory and secondary 

35 mass storage. At the time the web document is received, the 
cache determines if any embedded objects are maintained in 
i he cache but are not In primary memory . If those embedded 
objects are not in primary memory, the cache automatically 
pre-loads those embedded objects from secondary mass 

40 storage to primary memory without need for a request from 
the web client. 

In a preferred embodiment, web documents maintained in 
the cache are periodically refreshed, so as to a ssure those 
weiujo aiments are not "stale" (changed at the web server 

45 but not at the cache). The invention is applied both to 
o riginal requests to communicate web documents and th eir 
e mbedded objects from the web server to the web client, a nd 
t o refresh requests to communicate web documents and the ir 
e mbedded objects from the web server to the cache. 

50 1 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows a block diagram of a system for shared 
cache parsing and pre-fetch. 

55 FIG. 2 shows a flow diagram of a method for shared cache 
parsing and pre-fetch. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 

60 In the following description, a preferred embodiment of 
the invention is described with regard to preferred process 
steps and data structures. Those skilled in the art would 
recognize after perusal of this application that embodiments 
of the invention can be implemented using one or more 

65 general purpose processors or special purpose processors or 
other circuits adapted to particular process steps and dala 
structures described herein, and that implementation of the 
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process steps and data structures described herein would not 
require undue experimentation or further invention. 

Inventions disclosed herein can be used in conjunction 
with inventions disclosed in one or more of the following 
patent applications: 

Provisional U.S. application Ser. No. 60/048,986, filed 
Jun. 9, 1997, in the name of inventors Michael Mal- 
colm and Robert Zarnke, titled "Network Object Cache 
Engine", assigned to CacheFlow, Inc., attorney docket 
number CASH-001. 

U.S. application Serial No. 08/959,058, (now U.S. Pat. 
No. 6,128,701) filed this same day, in the name of 
inventors Michael Malcolm and Ian Telford, titled 
"Adaptive Active Cache Refresh", assigned to 
CacheFlow, Inc., attorney docket number CASH -003. 

ITiese applications are referred to herein as the "Cache 
Disclosures," and are hereby incorporated by reference as if 
fully set forth herein. 
System Elements 

FIG. 1 shows a block diagram of a system for shared 
cache parsing and pre-fetch. 

A system 100 includes a cache 110, at least one client 
device 120, and at least one server device 130, Each client 
device 120 is coupled to the cache 110 using a client 
communication path 121, such as a dial-up connection, a 
LAN (local area network), a WAN (wide area network), or 
some combination thereof. Similarly, each server device 130 
is also coupled to the cache 110 using a server communi- 
cation path 131, such as a dial-up connection, a LAN (local 
area network), a WAN (wide area network), or some com- 
bination thereof. In a preferred embodiment, the client 
communication path 121 includes a LAN, while the server 
communication path 131 includes a network of networks 
such as an internet or intranet. 

As used herein, the terms "client" and "server" refer to a 
relationship between the client or server and the cache 110, 
not necessarily to particular physical devices. As used 
herein, one "client device" 120 or one "server device" 130 
can comprise any of the following: (a) a single physical 
device capable of executing software which bears a client or 
server relationship to the cache 110; (b) a portion of a 
physical device, such as a sofivvarc process or set of software 
processes capable of executing on one hardware device, 
which portion of the physical device bears a client or server 
relationship to the cache 110; or (c) a plurality of physical 
devices, or portions thereof, capable of cooperating to form 
a logical entity which bears a client or server relationship to 
the cache 110. The phrases "client device" 120 and "server 
device" 130 refer to such logical entities and not necessarily 
to particular individual physical devices. 

The server device 130 includes memory or storage 132 
having a web document 133, the web document 133 includ- 
ing references to at least one embedded object 134. In a 
preferred embodiment, the web document 133 can include 
text and directions for display. Tlie embedded object 134 can 
include pictures, such as data in GIF or JPEG format, other 
multimedia data, such as animation, audio (such as stream- 
ing audio), movies, video (such as streaming video), pro- 
gram fragments, such as Java, Javascript, or ActiveX, or 
other w eb documents, such as when using frames. 
/ TEe cache 110 includes a processor 111, program and data 
* memory 112, and mass storage 113. The cache 110 maintains 
a first set of web objects 114 in the memory 112 and a second 
set of web objects 114 in the storage 113. (Web objects 114 
can comprise web documents 133 or embedded objects 134 
or both.) 

In a preferred embodiment, the cache 110 includes a cache 
device such as described in the Cache Disclosuresdefined 
herein, hereby incorporated by reference as if fully set forth 
therein. 



The cache 110 receives requests from the client device 
120 for a web object 114 and determines if that web object 
114 is present at the cache 110, either in the memory 112 or 
in the storage 113. If the web object 114 is present in the 

5 memory 112, he cache 110 transmits the web object 114 to 
the client device 120 using the client communication path 
121. If the web object 114 is present in the storage 113 but 
not in the memory 112, the cache 110 loads the web object 
114 into the memory 112 from the storage 113, and proceeds 
as in the case when the web object 114 was originally 
present n the memory 112. If the web object 114 is~"noT 
present in either the memory 112 or the storage 113, the 
cache 110 retrieves the web object 114 fronxlfre jippropria te, 
S£T\^rjJeyjcjJ30^places the web object 114 in the memory 
112 and the storage 113, and proceeds as in the case when 

15 the web object 114 was originallv present in the memory 
112. 

Due to the principle of locality of reference, it is expected 
that the cache 110 will achieve a substantial "hit rate," in 
which many requests from the client device 120 for web 
20 objects 114 will be for those web objects 114 already 
maintained by the cache 110, reducing the need for requests 
to the server device 130 using the server communication 
path 131. 

The cache 110 parses each web object 114 as it is received 
25 from the server device 130, separately and in parallel to any 
web client program operating at the client device 120. If the 
web object 114 is a web document 133 that includes at least 
one reference to embedded objects 134, the cache 110 
identifies those references and those embedded objects 134, 
30 and determines if those embedded objects 134 are already 
maintained in the cache 110, cither in the memory 112 or the 
storage 113. 

If those embedded objects 134 are not in the cache 110 at 
all, the cache 110 automatically, without need for a com- 

35 mand from the web client, requests those embedded objects 
134 from the server device 130. 

The cache 110 has a relatively numerous set of connec- 
tions to the server communication path 131, and so is able 
to request a relatively numerous set of embedded objects 

40 1 34 in parallel from the server device 130. Moreover, the 
cache 110 parses the web document 133 and requests 
embedded objects 134 in parallel with the web client at the 
client device 120 also parsing the web document 133 and 
requesting embedded objects 134. The embedded objects 

45 134 arc available to the cache 110, and thus to the client 
device 120, much more quickly. 

If those embedded objects 134 are maintained in the cache 
110, but they are in the storage 113 and not in the memory 
112, the cache 110 automatically, without need for a com- 

50 mand from the web client, loads those embedded objects 134 
from the storage 113 into the memory 112. 

In a preferred embodiment, those wdLobiecls-114-roain- 

la i ntvl iq the c -Mfhe 110 Art- pejinrl it-ally refr^he.d, '» 
a ssure jtiose web objects 114 are not "stal ' J " ('' h anK*^ ;tl lhp 

55 serv e rdev ice 130 buj^QQ^-at ihe cache 110). T orefresh web 
objecj s, 114, the_ cach e 110 selects one web obiec Llfcl for 
retTesJL and transmits a request to the server device 130 for 
that web ob jcctJL14. The server device 130 can respo nd with 
a copy of the web object 114, or can respond with a message 

60 that the web object 114 has not changed since the most 
recent copy of the web object 114 was placed in the cache 
110. If the web object 114 has in fact changed, the cache 110 
proceeds as in the case when a client device 120 requested 
a new web object 114 not maintained in the cache 110 at all. 

65 If the web object 114 has in fact not changed, the cache 110 
updates its information on the relative freshness of the web 
object 114, as further described in the Cache Disclosures. 
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Method of Operation 

FIG. 2 shows a How diagram of a method for shared cache 
parsing and pre-fetch. 

A method 200 includes a set of flow points to be noted, 
and steps to be executed, cooperatively by the system 100, 
including the cache 110, (he client device 120, and the server 
device 130. 

At a flow point 210, the client device 120 is ready to 
request a web document 133 from the server device 130. For 
example, the web document 133 can comprise an HTML 
page having a set of embedded objects 134. 

At a step 221, the client device 120 transmits a request for 
the web document 133, using the client communication path 
121, to the cache 110. 

At a step 222, the cache 110 determines if that web 
document 133 is located in the memory 112 at the cache 110. 
If so, the cache 110 proceeds with the step 225. Otherwise, 
the cache 110 proceeds with the step 223. 

At a step 223, the cache 110 determines if that web 
document 133 is located in the storage 113 at the cache 110 
(but not in the memory 112). If so, the cache 110 loads the 
web document 133 from the storage 113 into the memory 
112, and proceeds with the step 225. Otherwise, the cache 
110 proceeds with the step 224. 

At a step 224, the cache 110 transmits a request to the 
server device 130 for the web document 133. The server 
device 130 receives the request and transmits the web 
document 133 lo the cache 110. The cache 10 stores the web 
document 133 in the memory 112 and the storage 113 and 
proceeds with the step 225. 

At a step 225, the cache 110 transmits the web document 
133 to the client device 120 for display. In parallel, the cache 
110 parses the web document 133 and determines if there arc 
any references to embedded objects 134, If not, the cache 
110 proceeds with the flow point 230. Otherwise, the cache 
proceeds with the step 226. 

At a step 226, the cache 110 identifies the embedded 
documents 134 and repeats the steps 222 through 226 
inclusive (including repeating this step 226) for each such 
embedded document 134. Web documents 133 in "frame" 
format can refer to embedded documents 134 that are 
themselves web documents 133 and themselves refer to 
embedded documents 134, and so on. There is no prospect 
of an infinite loop if web document 133 is self-referential 
because the cache 110 will simply discover at the second 
reference that the web document 133 is already maintained 
in the cache 110. 

At a flow point 230, the web document 133 and all its 
embedded objects 134 have been transmitted to the client 
device 120 for display. 

When the cache 110 refreshes a web object 114, the cache 
110 performs the steps 222 through 226 inclusive (including 
repeating the step 226) for the web object 114 and for each 
identified embedded object 134 associated with the web 
object 114. 

Alternative Embodiments 

Although preferred embodiments are disclosed herein, 
many variations arc possible which remain within the 
concept, scope, and spirit of the invention, and these varia- 
tions would become clear to those skilled in the art after 
perusal of this application. 
What is claimed is: 
1, A method, including the steps of: 
receiving a web document at a shared cache from a web 
server or mass storage for communicating said web 
document to a web client for display; 
parsing, by said shared cache, said web documents for 
reference to embedded objects; 
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determining if said embedded objects are already main- 
tained in said shared cache; and 

periodically refreshing said embedded objects by select- 
ing at least one cached object actually present in said 
shared cache, and for the selected object, requesting 
from said web server a new copy of the selected object 
without need for a command from said web client. 

2. A computer controlled method for reducing access 
delays associated with accesses to a proxy cache, said proxy 
cache having a mass storage, a memory and at least one 
central processor unit (CPU), said mass storage and said 
memory for storing a plurality of cached objects received 
from a network from at least one server, said method 
including steps of: 

providing, by said proxy cache, a specified web document 
from said at least one server responsive to a request 
from a> client; 

parsing, by said proxy cache, said specified web docu- 
ment to identify a set of embedded references; 

determining, by said proxy cache, which of said set of 
embedded references reference a set of not-cached- 
objects not in said plurality of cached objects; 

requesting, by said proxy cache and independent of an 
additional request from said client, one or more of said 
set of nol-cached-objects responsive to the step of 
determining; 

receiving, by said proxy cache, said one or more of said 

set of nol-cached-objects; 
adding, by said proxy cache, said one or more of said set 

of not-cachcd-objccts to said plurality of cached 

objects; and 

periodically refreshing said embedded objects by select- 
ing at least one cached object actually present in said 
proxy cache, and for the selected object, requesting 
from said server a new copy of the selected object 
without need for a command from said client. 

3. The computer controlled method of claim 2, wherein 
the step of providing includes steps of: 

receiving, by said proxy cache, said request from said 
client for said specified web document from said at 
least one server; 

requesting, by said proxy cache, said specified web docu- 
ment from said ai least one server; 

receiving, by said proxy cache, said specified web docu- 
ment; 

adding, by said proxy cache, said specified web document 
to said plurality of cached objects; and 

sending, by said proxy cache, said specified web docu- 
ment to said client to satisfy said request. 

4. The computer controlled method of claim 2, wherein 
the step of requesting one or more of said set of not-cached- 
objects includes requesting a plurality of said set of not- 
cached-objecls in parallel. 

5. The computer controlled method of claim 2, further 
including steps of: 

receiving, by said proxy cache, a new request identifying 
one of said set of embedded references; and 

sending, by said proxy cache, a requested object from said 
plurality of cached objects, said requested object 
responsive to said new request. 

6. The computer controlled method of claim 2, whereby 
said set of embedded references is selected from the group 
consisting of a reference to numerical data, a reference lo 
textual data, a reference to multimedia data, a reference to 
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audio data, a reference lo video data, a reference to program 
data, or a reference lo a web document. 

7. A system, including 

a shared cache coupled to at least one web server and 
coupled to a plurality of web clients, said shared cache 5 
being capable of receiving requests for web documents 
from said web clients, requesting said web documents 
from said web server or mass storage, receiving said 
web documents from said web server or mass storage, 
and communicating said web documents to said web 10 
clients; 

said shared cache including: 

means for parsing said web documents for references to 
embedded objects; 

means tor determining if said objects are already main- 15 
tained in said shared cache; and 

means for periodically refreshing said embedded objects 
by selecting at least one cached object actually present 
in said shared cache, and for requesting, for the selected 
object and from said web server, a new copy of the -° 
selected object without need for a command from said 
web clients. 

8. A proxy cache having a central processing unit (CPU) 
and a memory coupled to said CPU for reducing access 
delays associated with accesses lo said proxy cache, said 25 
proxy cache having a mass storage, said mass storage and 
said memory for storing a plurality of cached objects 
received from a network from at least one server, said proxy 
cache includes: 

a cache mechanism configured to provide a specified web 30 
document from said at least one server responsive to a 
request from a client; 

a parse mechanism configured to parse said specified web 
document to identify a set of embedded references; ^ 

a selection mechanism configured to select which of said 
set of embedded references reference a set of not- 
cached-objects not in said plurality of cached objects, 
said set of embedded references determined by the 
parse mechanism; 40 

a pre-fetch mechanism configured to request, indepen- 
dently of an additional request from said client, one or 
more of said set of not-cached-objects responsive to the 
selection mechanism; 

a reception mechanism configured to receive said one or 45 
more of said set of not^cachcd-objccts requested by the 
pre-fetch mechanism; 

a cache inserlion mechanism configured to add said one or 
more of said set of not-cached-objects to said plurality 
of cached objects after receipt by the reception mecha- 50 
nism; and 

a cache refresh mechanism configured to periodically 
refresh said plurality of cached objects by selecting al 
least one cached object actually present in said proxy 
cache, and for the selected object, requesting from said 55 
server a new copy of the selected object without need 
for a command from said client. 

9. The proxy cache of claim 8, wherein the pre-fetch 
mechanism includes a parallel request mechanism config- 
ured to request a plurality of said set of not-cached-objects 60 
in parallel. 

10. The proxy cache of claim 8, whereby said set of 
embedded references is selected from the group consisting 
of a reference to numerical data, a reference to textual data, 

a reference to multimedia data, a reference lo audio data, a 65 
reference to video data, a reference lo program data, or a 
reference to a web document. 



11. A shared cache, including 

means for parsing web documents, said web documents 
being received from a web server or mass storage, for 
references to embedded objecLs; 

means for determining if said objects arc already main- 
tained in said shared cache; and 

means for periodically refreshing said embedded objects 
by selecting at least one cached object actually present 
in said shared cache, and for requesting, for the selected 
object and from said web server, a new copy of the 
selected object without need for a command from said 
web client. 

12. A computer program product including: 

a computer usable storage medium having computer 
readable code embodied therein for causing a 
computer, having a memory and a mass storage, to 
reduce access delays associated with accesses to a 
proxy cache, said mass storage and said memory for 
storing a plurality of cached objects received from a 
network from at least one server, said computer read- 
able code including: 

computer readable program code configured to cause 
said computer to effect a cache mechanism config- 
ured to provide a specified web document from said 
at least one server responsive to a request from a 
client; 

computer readable program code configured to cause 
said computer to effect a parse mechanism config- 
ured to parse said specified web document to identify 
a set of embedded references; 

computer readable program code configured to cause 
said computer to effect a selection mechanism con- 
figured to select which of said set of embedded 
references reference a set of not-cached-objects not 
in said plurality of cached objects, said set of embed- 
ded references determined by the parse mechanism; 

computer readable program code configured to cause 
said computer to effect a pre-fetch mechanism con- 
figured lo request, independently of an additional 
request from said client, one or more of said sel of 
not-cached-objects responsive to the selection 
mechanism; 

computer readable program code configured to cause 
said computer to effect a reception mechanism con- 
figured to receive said one or more of said set of 
not-cached-objects requested by the pre-fetch 
mechanism; 

computer readable program code configured to cause 
said computer to effect a cache insertion mechanism 
configured to add said one or more of said set of 
not-cached-objects to said plurality of cached objects 
after receipt by the reception mechanism; and 

computer readable program code configured to cause 
said computer to ellecl a cache refresh mechanism 
configured to periodically refresh said plurality of 
cached objects by selecting at least one cached object 
actually present in said proxy cache, and for the 
selected object, requesting from said server a new 
copy of the selected object without need for a 
command from said client. 

13. The computer program product of claim 12, wherein 
the pre-fetch mechanism includes computer readable pro- 
gram code configured to cause said computer to effect a 
parallel request mechanism configured to request a plurality 
of said set of not-cached-objecls in parallel. 

14. 'l*he computer program product of claim 12, whereby 
said sel of embedded references is selected from the group 
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consisting of a reference to numerical data, a reference to 
textual data, a reference to multimedia data, a reference to 
audio data, a reference to video data, a reference to program 
data, or a reference to a web document. 

15. A computer program product including: 5 
a computer data signal embodied in a carrier wave having 
computer readable code embodied therein for causing a 
computer, having a memory and a mass storage, to 
reduce access delays associated with accesses to a 
proxy cache, said mass storage and said memory for 30 
storing a plurality of cached objects received from a 
network from at least one server, said computer read- 
able code including: 

computer readable program code configured to cause 
said computer to effect a cache mechanism contig- 15 
ured to provide a specified web document from said 
at least one server responsive to a request from a 
client; 

computer readable program code configured to cause 
said computer to effect a parse mechanism config- -° 
ured to parse said specified web document to identify 
a set of embedded references; 

computer readable program code configured to cause 
said computer to effect a selection mechanism con- 
figured to select which of said set of embedded 25 
references reference a set of not-cached -objects not 
in said plurality of cached objects, said set of embed- 
ded references determined by the parse mechanism; 



computer readable program code configured to cause 
said computer to effect a pre-fetch mechanism con- 
figured to request, independently of an additional 
request from said client, one or more of said set of 
not-cached-objects responsive to the selection 
mechanism; 

computer readable program code configured to cause 
said computer to effect a reception mechanism con- 
figured to receive said one or more of said set of 
not-cached-objects requested by the pre-fetch 
mechanism; 

computer readable program code configured to cause 
said computer to effect a cache insertion mechanism 
configured to add said one or more of said set of 
not-cached-objects to said plurality of cached objects 
after receipt by the reception mechanism; and 

computer readable program code configured to cause 
said computer to effect a cache refresh mechanism 
configured to periodically refresh said plurality of 
cached objects by selecting at least one cached object 
actually present in said proxy cache, and for the 
selected object, requesting from said server a new 
copy of the selected object without need for a 
command from said client. 
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